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Abstract. We show that not only preferential attachment but also preferential 
depletion leads to scale-free networks. The resulting degree distribution exponents 
is typically less than two (5/3) as opposed to the case of the growth models studied 
before where the exponents are larger. Our approach applies in particular to biological 
networks where in fact we find interesting agreement with experimental measurements. 
We investigate the most important properties characterizing these networks, as the 
cluster size distribution, the average shortest path and the clustering coefficient. 
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1. Introduction 

From technological networks, like the Internet [I], to social contact networks, like sexual 
contacts [2] or friendship networks [3], to biological ones |3], networks are emerging in 
a variety of different fields. Often these networks are scale free, which means that the 
distribution of connections per node follows a power law. The understanding of the 
origin of this power-law can give insights in the network evolution and role. 
The first explanation of the power-law degree distribution was proposed by Barabasi and 
Albert [5]. They identified two mechanisms, growth and preferential attachment, as the 
main ingredients leading to scale-free networks. An increasing number of nodes and a 
constant number of new connections between new and old nodes, created preferentially 
with high degree nodes, lead to a power-law distribution. 

After this seminal work, other models with additional features as accelerating growth 
[6], aging [7], initial attractiveness [8] or fitness [9] have been developed. In the case of 
accelerating growth, additional edges are added between high degree nodes, whereas in 
the model with aging, old nodes are less likely to create new connections. Moreover, the 
influence of the connectivity can be reduced by a constant initial attractiveness or even 
replaced by a fitness function [9|. All these models have the same basic ingredients: 
growth and preferential attachment. Even replacing preferential attachment by similar 
mechanisms, the evolution towards scale-free networks remains possible. For example, 
nodes and edges can be copied [10] , edges redirected [UJ , walkers can create additional 
connections p2j or deterministic rules implemented [T3] . In all these cases the power- law 
behavior is based on the creation of new connections or nodes. In Table [T] the exponents 
7 of the degree distribution for a variety of scale-free models are listed. 

In all of these growing network models, the exponent 7 of the degree distribution is 
larger than two, with the smallest value typically obtained for extreme values of the 
parameters of the respective model. They are appropriate to describe social networks, 
since typical social scale-free networks have a 7-value between two and three, however 
biological networks are characterized by significantly smaller values of 7 [1] . 

2. Depletion model 

Here we show that the preferential depletion of links, keeping the number of nodes 
constant, is a mechanism to generate scale-free networks with a small 7 value. The idea is 
inspired by the plastic adaptation of neuronal networks in the brain. Indeed, plasticity is 
one of the most astonishing properties of the brain, occurring mostly during development 
and learning [2H [22], and can be defined as the ability to modify the structural and 
functional properties of synapses. Modifications in the strength of synapses are thought 
to underlie memory and learning. Progressive depression of synaptic strength can lead 
to "pruning", i.e. removal of connections. This remodeling of synapses mimics the fine 
tuning of wiring that occurs during "critical periods" in the developing brain, when 
neuronal activity can modify the synaptic circuitry, once the basic patterns of brain 
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Table 1. Exponents of the degree distribution for different scale-free models and some 
social and biological networks. *two regimes; **C depends on fitness distribution 




Figure 1. (Colors online) Examples of scale- free networks created by depletion with 
a = 2, fc min = 1 and N = 500 (left side) and a = 2, fc min = 2 and N = 250 (right 
side) . The color code represents the degree of each site on a logarithmic scale and the 
connections between the hubs are highlighted. For fc m i n = 1 the network consists of a 
large number of small clusters, whereas for larger values of k m { n only a single cluster 
is present. In both cases hubs survive the depletion process [5T], 
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wiring are established [22] ■ Experimental measurements of the functionality network in 
human adults have evidenced that this is scale free (23]. Functional magnetic resonance 
imaging has indeed shown that this network has universal scale-free properties: it 
exhibits a scaling behavior for the out-degree distribution with an exponent 7 ~ 2.0, 
independent of the different tasks performed by the patient. It is interesting to notice 
that the 7 exponent found in experiments is smaller than the typical value found for 
non-biological networks (Table 1). Moreover, neuronal network models [2H EH] have 
evidenced that the presence of highly connected nodes is crucial for learning [26] . 

To implement this idea, we develop the following algorithm. The model starts with 
a fully connected network with N nodes. The evolution then removes edges according 
to the following rules: 

• Choose randomly a node %. 

• Choose one of the edges of node i, eij, according to the probability pij and remove 
it. The probability Pij is determined by the degrees kj of the neighbors j of the 
node i: 



where pj is 



x _ 1 k j a for k i > ^ min £ 2 ) 
otherwise 



and Ni the normalization 

l = hi 

N t = £ Pi- (3) 
1=0 

• Repeat this procedure until the number of edges M is equal to the number of nodes 
TV times the minimal degree k m i n . 

The depletion model introduces two free parameters, a > and fc m mj which control the 
morphology of the network and the scaling behavior of the degree distribution. Eq.(l) 
and (2) imply that the smaller the number of connections of node j, the higher is the 
probability to remove the edge e^, i.e. the poor get poorer. The value a = corresponds 
to the case of random depletion. 



3. Numerical results 



The different morphologies of two typical networks created by the depletion algorithm 
for fc min = 1 and 2 are shown in FigJI] A change in the minimal deg ree & m j n affects 
the structure of the network significantly. For k m i n = 1, we observe a large number of 
isolated small clusters and one large cluster, where for larger k min only one single cluster 
is produced. In the case k m [ n = 1, all small clusters have the minimal allowed number 
of edges M min = 5 — 1, where S is the number of nodes in a cluster. Furthermore, the 
giant cluster looks like a tree with a few hubs, each one connected to other hubs. 
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Figure 2. a) The degree distribution p(k) of the depletion model with a = 2 and 
fcmin = 2 for different system sizes N. In the inset we show the size dependence 1/N 
of the inverse of the crossover point k* between exponential and power-law regime, b) 
The degree distribution p(k) of the depletion model with N = 16000 and fc m in = 2 for 
different a values, c) The degree distribution p(k) of the depletion model with a — 2, 
fcmin = 2 and N = 8000 for different initial conditions. The larger the average initial 
degree of a regular lattice or a random network, the larger is the power-law regime of 
the final network. 



To characterize the level of connectivity of the network, we investigate the node degree 
distribution (Fig. [2|. The value of the parameter a controls not only the maximal 
degree, but the extension of the scaling behavior of the distribution. Only for a ~ 2, 
the algorithm creates asymptotically scale-free networks. For a < 2 the range of the 
power-law behavior is limited by an exponential decay that sets in at intermediate k, the 
sooner the smaller the value of a. For a = the degree distribution is a pure exponen- 
tial. For values of a increasing beyond 2 the power-law regime decreases, the effective 7 
exponent increases and the distribution develops a small bump at intermediate k. (Fig. 

In contrast, the parameter fc m i n has no major impact on the overall scale-free behavior. 
It controls the minimal degree of the network, however the degree distributions of the 
entire network with the same parameters, but different k m i n are similar. In Fig. [2^ the 
scaling of the degree distribution of our depletion model with network size N is shown. 
The best fit is p(k) ~ k~ 5 ^ 3 which represents the asymptotic behavior for infinitely large 
networks. This value of the exponent 7 is thus smaller than for any other scale-free 
model network. In the inset we see the growth of the power law regime with the size 
of the network. The best fit for the crossover point k* follows a power- law k* ~ ]\[0.53^ 
showing that indeed our network is asymptotically scale-free. 

Let us next question if a fully connected initial configuration is necessary to generate 
scale-free networks. Therefore we test three different initial networks. First, we start 
from a random lattice where each node is connected with fc neighbors [27] • Second, 
we start from a random network with a large average degree (ko) 3> 1 [28]. Finally, we 
test a lattice with a random initial degree configuration, where the degrees are chosen 
from a uniform distribution, ko G [kmin , ■ ■ ■ , N — 1]. For the first two initial conditions, 
the degree distributions for the final depleted networks show power-law regime, whose 
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Figure 3. Frequency f(S) to find a cluster with a given number of nodes 5(bottom) or 
edges S(top) in networks with N = 4000 and fc min = 1 for different a values. Bottom 
data sets for nodes are shifted vertically by a factor of 10 for better visibility. 



extension increases with increasing initial average degree (ho). Conversely, the third 
initial condition is not sufficient to generate a degree distribution with power-law be- 
havior, although the starting network has a high average degree (fco) ~ ^j^- These 
results, shown in Fig. [2^, indicate that a dense and uniform initial network is necessary 
to create scale-free networks with our depletion algorithm. 

Starting again with a fully connected network we now analyse the cluster size distribu- 
tion in the case where the algorithm generates a disconnected structure. In Fig. [3] the 
frequency / to find a cluster with a given number of nodes Sn or edges Sm is shown 
for the depletion model with fc min = 1. The probability to find a cluster of given size 
follows approximately power-laws f(S) ~ S^ 13 with /3 around 3.5 for nodes and 4 for 
edges only weakly dependent on the parameter a. 

In recent years small world properties [2H] of natural networks have emerged in different 
fields. These properties do not necessarily concern the degree distribution, the nodes in 
fact may all have a degree close to an average value. They rather characterize the level 
of clustering and average distance between nodes. In order to determine if the networks 
generated by the depletion model are small world, we evaluate the average clustering co- 
efficient and the shortest path length (Fig. |3p for k m - m = 2 and k m m = 4. The clustering 
coefficient C is defined as the ratio of the number of observed triangles over the number 
of possible triangles in the network. The best fit for the average clustering coefficient C 
for networks with N sites follows the power-law C ~ N~ Ca with Co = 0.7 for k m i n = 1. 
Surprisingly the exponent Cq = 0.24 is found consistently for networks with different 
fcmin > 1, as long as fcmin <C N — 1. Although the clustering coefficient decreases with 
system size, it decreases slower than for random networks or Barabasi- Albert networks, 
which are characterized by an exponent Cq = 1 and Cq ~ 0.75 respectively. 
For the same networks, the average shortest path length (I) follows the double logarith- 
mic behavior I = c ln(ln(ciA r )) + c 2 for all fc min > 1 with different fitting parameters 
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Figure 4. The size dependence of the average shortest path length (I) for the depletion 
model with a — 2 and different fc min values. (I) follows the double logarithmic behavior 
I oc ln(ln(0.027V)) for fc min = 2 and I oc ln(ln(0.21iV)) for fc min = 4 respectively. Inset: 
The size dependence of the average clustering coefficient C for the depletion model 
for both values of fc min . The best fit for the clustering coefficient follows a power-law 
C oc N~ - 7 and C oc N~ - 24 for k m i n = 1 and fc m ; n > 2, respectively. 



Co, c\ and C2- Notice that for k m - m = 1 the average shortest path length is not well 
defined, since the network consists of isolated clusters. The increase is slower than log- 
arithmic, which is found in the random case. This dependence is typical for ultra-small 
networks [30] . 

4. Conclusions 

In summary we have introduced a new model to create scale-free networks based on 
preferential depletion of edges (for a = 2). The networks exhibit an exponent 7 ~ 5/3 
for the degree distribution independent of parameters and smaller than the values ob- 
tained by growth models. Interestingly this value is in very close agreement with the 
corresponding exponent of the Escherichia coli metabolic network [T3] or the gene func- 
tional interaction network [IS] . As opposed to these models, the depletion model can 
also generate disconnected structures, as observed in many biological systems, by tuning 
the value of the minimal number of edges. These results suggest that depletion rather 
than growth is the mechanism at the basis of the emergence of scale-free networks in 
biology. 
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